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ABSTBACT 

This paper contends that much of vhat passes as 
••educational research** has all the appearance, but little of the 
substance, of scientific research and that the educational community 
should realize this fact and condemn the imitation, while working to 
improve scientifically based and conducted projects. Problems in the 
field center around (1) the mechanisms, attitudes, political 
structures, and reward systems existing in elementary and secondary 
education; (2) the time span allowed in developing pr,oposals and 
conducting research and for results to become evident; (3) the 
self- reinforcing attitude of distrust and doubt among educators, who 
are wary of new research because of previous unfavorable research^ 
Besponsibility for changing the quality of research rests in four 
basic areas: (1) the financial support system, (2) participatory 
school systems, (3) the researchers, and (4) research training 
programs. Given the problems involving current systeais which do not, 
and cannot, effect rigorous applied research in education and the 
general distrust regarding research as an effective change agent, the 
author makes nine recommendations to improve the situation, involving 
(1) organizational systems, (2) legal status of research 
organizations, (3) regional orientation, (4) materials and equipment 
identification and acquisition, (5) model research activities, (6) 
communication and, implementation pf data, (7) information 
dissemination, (8) communication and implementation of successful 
programs, and (9) feedback into training programs. (MB) 
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Introduction 



Educators, lavmakers and the public In general are showing Increasing disenchant-* 
nent with research as a useful, probleot-aolvlng method for elementary and secondary 
schools. The prospect for research Is serious enough that we, as professionals 
In the field, shoxild review %rtiat Is causing this precipitous decline In support. 
Briefly, the arguments surrounding scientific research In education have run something 
like this. Research advocates point to extensive achievements attained through 
scientific research that not only have benefited society, but that have also 
enhanced the ability of science itself, to undertake rigorous studies of a more 
c(»Bplex nature. Integrated circuitry, for example, is cited as having provided for 
development of computers that are physically smaller in size but which can manipulate 
data with greater speed and accuracy. These increased capabilities, in turn, have 
led to the development of more sophisticated analytic methods. Why, then, the 
advocates ask, do we not receive support to bring these resources effectively to 
bear on educational problems that impair our ability to achieve cost-effective 
high quality education? 

Critics of educational research respond by referring to the era of the 1960 's 
and early 1970 *s when large sums of money were made available to educational 
institutions through various governmental and private agencies for research and 
development of innovative programs, instructional strategies, products, services, 
and management modes. They point out that educational researchers were actively 
Involved during that period, but their efforts contributed virtually nothing toward 
substantial Improvement in any of these areas. Further, they contend, many research 
findings were obscure and often in direct contradiction with one another, leading 
to adumbration instead of illumination. Tha critics allege that the research 
conducted was often ill-conceived, poorly designed. Ineptly handled, and many 
times was misdirected, failing to address the root of the problem requiring 
investigation. Thus they conclude, based on past experience, further research 
in education is not likely to contribute useful information and is, therefore, 
of little or no value. 
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It ±8 a tnajor contention of this paper that most research In education, both past 
and present 9 is a sort of "Fool's Gold," That is, the work to date has all the 
appearance, but little of the substance, of scientific research. Therefore, what 
is being condemned is not scientific research itself, but useless imitations of it. 



Why Fool*s Gold? 

There are numerous current problems associated with implementing scientific research 
in education. These problems, for the most part, center around the mechanisms, 
attitudes and political structures that exist in elementary and secondary education. 
For eacan?>le, rarely is the opportunity available for meeting the logical conditions 
of the hypothetico-^eductive model in educational settings. Here I am referring to 
both the technical requirements (e.g. randomization and experimental control of 
relevant variables) and political requirements (e.g. a genuine desire on the part 
of educators and the public in general to seek truth, no matter how much it hurts)* 
Political constraints are often generated by local social conditions. For Instance, 
those involved In elementary and secondary education often lack freedom in 
decision-^klng because a particular specific outcome is desired by the community 
(or some power segment therein), regardless of the educational consequences. 

A further factor that inhibits the conduct of sc entiflG research is that 
requislt reward conditions for seeking truth ^d making rational change are 
not present in education. Instead the general scene appears to be one of 
fear and defenslveness associated with decision-making. The end result is 
that no reward is given for the well-done, definitive, objective study because 
there is no significant evidence that individuals ifi education, governmental 
agencies or the public in general, really want such research. In fact, quite 
the opposite may be true. Where research adequacy is questionable, the 
decision-maker is afforded the alternative of making the popudar decision without 
fear of retribution from the findings of the report. 
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This anomaly Is coomonplace, due to the nature of the existing environment where 
adequacy of educational research is usually saapect. Thus, the user can be 
selective in citing those studies which support his/her position. Opposing 
research reaxilts are easily tarred with a wide, sweeping brush aince neither the 
public nor educators are able to discriminate between the Jargon of the "quack" 
and the technically precise language of the research specialist. It is, therefore, 
eaay for the decision-maker to conclude, as best suits the immediate political 
situation, that the one is the other, leaving everyone in the dark about which 
is really true. To add to the problem, educators frequently are unable to separate 
the competent research (and researr^her) from the lncoiiq>etent or unscrupulous through 
either review of published studies or recommendations from tmlversities. 

The Izoportance of this problem Is easily seen, for if schools were unable to 
readily dismiss unpalatable research findings, they would be required to take 
action on the acquired knowledge. It is apparent from the amount of support one 
finds among elementary and secondary educators that they do not want to be put 
into this poslcion* As a result, one has a form of Gresham's Law in effect here: 
that inferior coinage inevitably replaces superior coinage. As long as poor 
studies are available in such abundance, it tends to discourage the competent 
researcher. As a result, the market is flooded with Fool's Gold and the real 
article disappears from circulation. 

A second reason why much of what is called educational research is only Pool's 
Gold is that those who seek solutions to educational issues tend to demand 
answers in unrealistically short time periods. This impatience is manifested in 
numerous ways, from Federal governmental agencies to local school districts. 
To Illustrate — 

A cocaaon frustration among recipients of Requests for Proposals, is the short 
timeline between receipt of an RFP and the due date of the detailed proposal, 
and bett^een the time of project commencement and the date when impact resulta 
must be presented. Often there is insufficient time to develop an appropriate 
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conceptual framework or research design and to allow enough time for the impact 
of the treatment to manifest Itself. Thus many projects which may l<K)k promising 
do not obtain continuation funds because they do not show statistically significant 
change In the time allotted by the RFF, 

The Impact of ''Fool's Gold" Research 

The most serious ccLisequenee of non-scientific ''Fool^s Gold" resc^arch has' been 
the generation of an atmosphere of distrust and doubt among educators. They doubt 
that research can be an Important tool in dealing with their problems • Azul even 
if it could » they doubt whether those^of us in research are able to comaunlcate 
valid research findings to them In a manner that is meaningful and useful. In 
several past graduate research courses that I have taught in an area university » 
I have attempted to Instill In the students an understanding of the nature » role, 
and methods of the scientific approach for obtaining knowledge that will aid in 
overcoming educational problems « This Is followed by a reqtilrement that they 
conduct a review of recent (past ten to fifteen years) research completed within 
their own areas of specialty. 

Without going into the numerous inadequacies in design and conduct of research 
they typically identified, a general complaint frequently heard in their reports 
was their inability to understand the technical terminology found In the research 
and the difficulty they experienced in attempting to Interpret the statistical 
tables presented • Since most of the substantive discussions in the reports they 
read made reference to either analytical techniques or some portion of the tables » 
the teachers were frequently unable to meaningfully interpret the findings or 
understand the discussion. Often, the report formats not only turned the teachers 
off, but added to their dissatisfaction of the usefula'^ss of research in education 
in general. The teachers showed even greater tmhapplness with the inconsistencies 
and contractions fo\ind in studies purporting to be investigating similar problems. 
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As an interesting aside ^ ve found very few teachers who have heard of AERA and 
practically none have read Its publications. For whom does the organization 
exist? Researchers? University professors? These groups most likely represent 
the major portion of the organisation's readership and membership. Yet, vfaere do 
the educational problems exist? At the elementary and secondary levels. And it 
is elementary and secondary educators that should be the target audience of an 
organization that has American Education as a part of Its title. These same 
criticisms could be directed at the National C?>uncll for Measurement in Education 
and other organizations as well. I suspect very few teachers are aware of the 
existence of NCME. Yet testing problems are on the forefront of significant 
issues in American elementary and secondary edifccatlon today , and educators are. 
almost totally unaware of the nature of current testing problems and the studies 
underway that will hopefully lead to better understandings of mental measuranent 
systems. 

If one wished to continue the basic thesis of this paper In terms of detailing 
more specifics, it would be easy to do. However, it seems Justified to conclude 
that the point has been made; disciplined, scientific research is generally 
not being conducted in elementary and secondary schools today. 



Problems with Current Systems 

As I've tried to point out, the blame for this situation is not one-sided, but 
is rather multi-faceted. Responsibility for successful research lies in four 
basic areas: the financial support systems underlying the research, the school 
systems which participate in the research, the researchers themselves, and present 
research training programs. The actual conduct of research, however, is currently 
most often imder taken through one or more of four types of agencies: the univer- 
sities; federal, state, and local governments; voluntary non-profit cooperatives; 
and private corporations. In spite of the vast availability of talent and 
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support afforded educational research in the past through the0e 

Is evident that they are not effective for completlttg ^^^l-^iflciP'''^^^^ research 

in education* 

Before offering recommendations for developing a model for ^ ^^gaJ^^^^tional 
system, perhaps a quick review of factors that have pJ^^^^^ed ct>^^^^ agencies 
from being successful might help clarify the rationale for ^he ire^^^^^^^^^^®* 

Problems vlth Universities 

Universities have historically fulfilled three roles 1» th^ are^ educational 
research; the training of researchers, the development of techa^^^^''^*^^^ capabilities 
to support research data organization and interpretatlon> and tti® research 
consultants to assist schools in their research efforts- jodgo^nt, the 

tjniverslties have been least successful in the first sxtd t^^xd J^o^-^^* strikingly 
successful, particularly over this past decade, tn the secox^d to^^' ^^rhaps t e 

1^ t hel r 

most severe limiting factor related to university involvem^^^ i^e^ 

inability to devote significant resources internally over Xoag ^^^^^^^ time, 

to local multiple » complex educational issues. 

hv 

Consequently, their assistance has been generally sporatic cjs^^ ^ case> 

. . ^^^1 J J 1 Where universities 

based on specific elementary and secondary educational ^^quests^ 

have attempted to initiate scientific research, local ^^^^^Oois te^^ ^^esist, 

due to a fear 

or only cooperate to a limited degree. The resistance is Usuali''' 

on the part of school personnel of university infringem^i^t tl>^^^ <Jomain 

- ^/ration will be 

and/or a feeling by the educators that the results of the in^esl^*^ 

of little value to the schools snjrway. 
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Problems vlth Governmental Bureaucracy . 

Federal and state governmental agencies are tyj, p 

. ^ removed t^^^ the front 

lines of education to be effective In conducttj^ ^ti^^^^ Research 

result, they are forced to work through secon^, ^^^^ ^ fo^.^^^ ^ * 

^hltd ^ parties m attemptiM 

to accomplish their goals. One evidence of t^i^ u , . 

^ n\xot^^ ^® b^en gtaat award 
procedures which have led to funding of inept: Ikjcai 

^^earci** ^ Sovemmental ag®^<^l-ea. 
on the other hand, are so close to the probl^^xia a>p» , 

^hat ^ble to deal with 

them objectively or even, perhaps, to view th^^ ** pAw^ 

^^ti vto^ '^^pectlve. 
0 ^ 

Problems with Cooperatives 

Cooperative, non-profit research agenclea hav^ ^ . tlnilh^, 

^^ovld^^ ^ usefulness it^ 

conducting survey research, but lack requisite ^ for i,^. 

^ ^^titrol^ ^dertaklng wortant 

research due to competing forces among the el^te^ ^ -tie cn^ 

, ^^ts oi ^ ""Operative. ^Iso, 
member schools possess the ability to maintain ^utroi 

. ^^Gct activities 
of the agency, keeping them at bay and away i^Kst. , u^'^ l^aim 

^ ^*tou^^^ ^® (t*£-» thoae 
practices and activities which may be a part Of rt^Kot-^ 

. ^^acb^^ ^^^tlons and arbitration, 

those where financial interests may be involved ^^^e \»h4 ,^ 

* ^nd socially 
or politically unpopular) . ®° 

Problems with Private Consultants 

The fourth agency, the private corporation, ha^ ^^Mbitix^g r^e^ictlon 

to Its effectiveness — the profit motive basis . I the 

^$^j-lvit*« existence of 

the organization Itself. This was cleairly br^ij^, ( ,^ a >.-,^ ^ 

. , . % oui^ ^ ""^^^ent publtcatlon 

where a nationally known researcher/evaluatot Qd,. V / .-/i a ha-^ 

^tte<J *^ "^sitancy about 
"biting the hand that feeds it" in research rej^^j '^'^^ 
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Given the failures of Fool^s Gold research, school systems have resorted to 
philosophical. Intuitive, and subjective ("tried and true") beliefs as the 
fundamental rationale for selection, rejection, or alteration of educational 
practices. There are even those who advocate a greater reliance on faith as 
the basis of declslon-inaklng. The reluctance of educators to move toward 
scientific research as a basis for decision-making Is based on their past 
experience- with research. It has even led to the development of a strong belief 
that most educational achievements are not empirically measurable, a defensive 
and weak argument. 

IHie to the inherent characteristics of existing agencies, the problems cited in 
using scientific research to provide a rational basis for effecting educational 
change, are likely to continue « Thus, the logical conclusion is that there 
must be change in the systems of educational research if the latter is to become 
potent . 

The fundamental propositions of this paper are: (1) that new organizational 
strategies and systems must be developed outside of (but perhaps in association 
with) research agencies currently in existence to change attitudes toward research 
as a meana of resolving educational problems, and (2) that the catalyst for this 
must be developed by changing the mechanisms for researching educational problems* 



Recommendations 

The nature of some of the required changes are easily identifiable while others 
are not* The mechanisms needed to support scientific research are evident. 
For example, increased efficiency in data acquisition, greater sophistication 
in data reduction, and related enhancements in technology that will accommodate 
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organized massive data storage and rapid retrieval are research needs that 
are fairly obvious • The more difficult aspects to outline are those related 
to the specification of more effective organizational strategies and systems, 
including those for training the researcher .and establishing methods of actually 
conducting truly scientific research in field settings. As stated kbove, it is 
here that new systems and procedures need to be conceptualized and developed, 
utilizing those components of existing agencies that have demonstrated themselves 
to be successful, to accomplish this goal» 

Given the premise that the current systeans do not and cannot effect rigorous 
applied research in education and.-&tiat a general distrust regarding the change 
potential of research findings. in -Question exists among educators and the public 
in general, the following recommendations are offered for consideration: 

1. Conceptualize new organizational model systems that will 

have educational research as their prime reason for existence. 
I believe that to be successful, such systems must have at 
least three req dsites: 



a. A close relationship, professionally and geographically, 
to elementary and secondary educational systems. 

b. Functional, but not dependent or subordinate, relatlohahlps 
with local, state, and federal level governmental agencies. 

c. Close and active liaison with university resources. 

2. Devise a legal basis for the model systems so that they may pursue, 
through scientific research, educational problems^ offsetting 
restrictive political and social forces associated with present 
voluntary participatory systems. 
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Develop the systems Into an Intranstate regional framework with 
legal authority lying somewhere between local and state governmental 
levels, such a& Intermediate school educational service centers. 
This Is not to add to existing bureaucracy, but rather to provide 
a means of protecting individual districts against the mindless 
predation of the distant state and federal bureaucracies and^ 
on the other hand, to overcome the resistance to change found at the 
local level. This would alao provide a method for coordination of 
efforts among the agencies. 

Identify and acquire the resources, materials, and equipment 
necessary to support the activities of the research system. 
These must include data management systems capable of handling 
massive quantities of data rapidly and efficiently on a cost-* 
effective basis. 

Undertake model research activities utilizing designs free of 
present constraints and based on Important existing educational 
problems. Although I realize this is more easily said than 
done, it must be accomplished in order to demonstrate the pod** 
sibility of such occurrences. 

Devise effective strategies for both communicating the reisults 
of such research activities to elementary and secondary educators 
and providing a means of assisting schools in Implementing 
changes resulting from the research findings. These efforts 
must be cohesive and veil-thought out to overcome prevailing 
untrustlng attitudes. 



When the changes have demonstrated positive impact, disseminate 
the occurrences widely, to prove to the public in general that 
quality research can make a difference in educational practice. 
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8. Once a model has proven to be successful > laplement It widely 
and establish an Inter-system coossunlcatlon network so that 
more pervasive educational problems can be Investigated 
through concerted efforts. 

9. Utilize Information gained through this process as a basis 
for modifying and improving research training programs that 
will turn out researchers competent to the tasks demanded 
of them* 

I am avaro that to implement the recommendations would be an arduous task, 
fighting uphill battles (particularly in the social and political arenas), but 
believe them xiecessary If educational research is to prove Itself • Once this 
is done> educ^. ional research is likely to acquire a general acceptance of value, 
overcoming Gresham's Law by reducing the supply of Fool's Gold research, and thus 
establishing scientific research firmly as an Integral part of American education. 
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